Designing In virtual Reality

DesIRe is a gesture recognition system designed to aid virtual reality systems interfaces. It works via a variant on MoCap: The user dons a pair of datagloves embedded with illuminated LEDs. These in turn are tracked by a four webcams, in a square formartion around the user's hands, such that each looks at the space where the user's hands should be; 90 degrees apart from the others. The cameras are divided into two pairs, each of which use stereoscopy to build up a 3D picture of where the user's hands are in space. Both pairs are necessary so as to correctly interpret gestures that involve one hand occluding the other, or a raised finger from an upturned hand, which one pair of cameras would not necessarily catch.

Additionally, from knowing the position and orientation of the user's hands, other parts of the body such as elbow and shoulders can be roughly inferred. This data is then interpreted by the computer system, either as MoCap data, or as interface commands, depending on the application used.

Unlike most interaction paradigms, DesIRe was designed for users with physical disabilities from the get go. Thus, it is suitable for all, with and without disabilities, so long as they have motor control of their hands. The DataGlove input is quite simplistic at the moment, but future work will lead to an increase in sensitivity to specific gestures, such as grasping, strumming, stroking, and other hand movements.

System creators:

Virtual and Interactive Simulations of Reality Research Group, at Macquarie University, Sydney, Australia

Technologies Used:

Vizard Virtual Reality Toolkit

immersive projection system

Precision Position Tracker (PPT)

Further Reading:

Virtual and Interactive Simulations of Reality Research Group (VISOR)

Gesture recognition